Lack of Ultrametricity in the Low- Temperature phase of 3D Ising Spin Glasses 
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We study the low-temperature spin-glass phases of the Sherrington-Kirkpatrick (SK) model and of 
the 3-dimensional short range Ising spin glass (3dISG) . By using clustering to focus on the relevant 
parts of phase space and reduce finite size effects, we found that for the SK model ultrametricity 
becomes clearer as the system size increases, while for the short-range case our results indicate the 
opposite, i.e. lack of ultrametricity. Another method, which does not rely on clustering, indicates 
that the mean field solution works for the SK model but does not apply in detail to the 3dISG, for 
which stochastic stability is also violated. 



Spin glasses constitute an example of a fascinating fam- 
ily of physical systems, in which the combination of dis- 
order and frustration produces a multitude of low-lying 
states, unrelated by symmetry. A major breakthrough 
came with Parisi's mean-field solution 1] of the infinite- 
range Sherrington-Kirkpatrick (SK) model 2J; a complex 
low-tcmperature phase with rich structure was revealed. 
One of the central open questions of the field is whether 
the qualitative structure of the mean-field solution is 
valid also for the experimentally relevant 3-dimensional 
short-range Ising Spin Glasses (3dISG). Both systems are 
described by the A^-spin Hamiltonian 
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where Si = ±1. In the SK model the sum in Eq. runs 
over all pairs of spins, while in the SdlSG the sum is over 
nearest neighbor sites of a cubic lattice. The interactions 
Jij are taken from a Gaussian distribution with mean 
zero and variance 1/(A'' — 1) in the SK model, while the 
variance is 1 for the SdlSG. 

To test the validity of the mean field solution, it is 
natural to consider first the most widely calculated ob- 
servable in ISG; the distribution P{q) of the overlaps q, 
defined for two states and as = A^~-^ Yl!i=i ^i^t- 
For each realization of the randomly selected Jij one cal- 
culates the probability distribution Pj (q) (at equilibrium 
at some temperature); P{q) = [P,j{q)]a.v is the average 
over the different realizations {J} of the disorder. In- 
deed, P{q) was measured by Monte-Carlo simulations 
and in other ways and non-trivial overlap distribu- 
tions were found for both the SK and 3dISG. However, 
there were clear indications that the low T phases of the 
two models were different In particular, evidence 

was presented j2] for lack of ultrametricity in 3dISG, and 
for the central role played by correlated macroscopic spin 
domains in producing a non-trivial P{q). 



Ultrametricity (UM) of the state space jaf is one of 
the main characteristics of the low T phase of the mean- 
field solution and the SK model. Consider an equilibrium 
ensemble of microstates at T < Tc, and pick three, p, fi 
and ly at random (see, however, point (a) below). These 
indices represent the states s^, and s*'. Order them so 
that g^iy > q^p > qfj^p] ultrametricity means that in the 
thermodynamic limit we get q,yp = g^p with probability 1 . 
In terms of the distances d^jy = (1 — qp^)/2 the condition 
of UM becomes d^p = dpp > dp_i, . 

Even though claims were made for the emergence of 
UM for large 3D systems 3, these were not conclu- 
sive. Since demonstrating lack of ultrametricity suffices 
to prove that the mean-field solution does not apply for 
the 3dISG, the evidence presented in 7] prompted Cilib- 
erti and Marinari (CM) 10] to use similar methods at 
the same system sizes as used by 7], to search for ul- 
trametricity in the SK model, which has an ultramet- 
ric low-T phase. CM did not see UM in the SK model 
and claimed that the system sizes used were too small to 
allow observation of ultrametricity. CM argued further 
that failure to see UM where it holds indicates that sim- 
ilar failure reported for the 3dISG does not provide 
evidence for its absence. 

In order to settle this issue we performed extensive 
simulations of the SK model for a somewhat larger range 
of sizes than in CM, and carried out a careful analysis of 
the results. We also applied the same method of analysis 
to our earlier ^] results for the 3dISG model. As opposed 
to CM, we do find clear evidence for UM in the SK model; 
it's signature becomes more pronounced as the system 
size increases. On the other hand, for the 3dISG we 
find the opposite; with increasing system size the results 
become less consistent with UM. We will explain in detail 
elsewhere 0| the reasons for the differences between our 
results and those of CM. Here we note that in order to 
observe UM one has to avoid three main pitfalls: 
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(a) If time reversal symmetry is unbroken (zero field), 
phase space structure consists of two spin-flip re- 
lated pure-state hierarchies (see Fig. UM can 
be observed only if all three states of each sampled 
triplet belong to the same side [lol . 

(b) Do not work too close to Tc otherwise finite size 
effects mask the signal. 

(c) At low T, most of the microstates belong to the 
same pure state 0. With increasing N the over- 
laps inside a pure state converge to (/ea and most 
{p, /z, v} triangles become equilateral, conveying no 
information on UM. 

To avoid pitfalls (a) and (c) we map out the upp er levels 
of the pure state hierarchy by clustering 

0,Ei| (see Fig 

P). To avoid (a), we consider only triplets of states from 
(say) the left tree and to avoid (c) we pick the three states 
from different pure states of this tree. 

Monte Carlo simulations: SK systems were simulated 
at sizes TV = 32, 128, 256, 1024. To speed up equilibration 
we used parallel temperingwith 21 temperatures ranging 
from 2.0 down to 0.2. Tests for equilibration were carried 
out as in Ref. Details of the simulations on the 3dISG 
are given m Ref.0 For each size we generated 500 differ- 
ent realizations {J} of the disorder (except for = 8'^ - 
only 335 realizations). For each {J} we generated 500 mi- 
crostates, sampled according the Boltzmann distribution 
at T = 0.2. Each sample of states was enhanced to 1000 
by adding to these 500 microstates their spin-flip mirror 
images. The result is two spin-flip related unbiased sam- 
ples - one from each tree. The microstates appear in the 
random order generated by the Monte Carlo procedure. 

Identification of pure states by clustering: The 1000 
microstates, obtained for a realization of the disorder 
{J}, are assigned to groups with a relative tree-like struc- 
ture by clustering. Here 0] we used the well known 
average linkage agglomerative clustering algorithm |l5l| . 
Initially each of the M — 1000 points (microstates) is a 
cluster; at every clustering step those two clusters a, /? 
that are closest are merged to form a new cluster 7; the 
process stops after M — 1 steps when all the points be- 
long to one cluster. The distance da^fs between clusters 
is defined as the average distance between points of a 
and /3. After every merging operation we record for the 
new cluster 7 = a U /3 the score = da^fs, and for each 
of the merged clusters a quality measure Va = s-y/sa- If 
Va is high, the distances between states within a are sig- 
nificantly smaller then the distances of these states from 
states outside a, and cluster a is "real" , i.e. not an arti- 
fact of the agglomerative procedure. 

Fig. n] presents the tree of clusters (dendrogram) ob- 
tained when the procedure outlined above was applied to 
the equilibrium ensemble of 1000 microstates, obtained 
at T = 0.2 for a particular realization {J} of the SK 
model with A^ — 1024 spins. The clusters at the higher 
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FIG. 1: (A) Clustering produces the dendrogram of state clus- 
ters, for the equilibrium ensemble of 1000 states, obtained by 
simulation of one realization of the SK model for 1024 spins, 
at T = 0.2. The vertical position of each cluster a is its score 
Sc. Logarithmic scale is used for the vertical axis; only clus- 
ters with Sa > 0.04 are shown. Significant clusters, identified 
by a long branch above them, have high values of «„; these 
clusters reflect presence of dense regions in the underlying 
Boltzmann distribution. (B) The distance matrix d^i, of the 
microstates, that were reordered according to their positions, 
as the leaves of the dendrogram, on the horizontal axis of (A) . 
Darker colors indicate smaller distances. 



levels of the hierarchy have high Va values, suggesting 
that the partitions they form indeed exist in the under- 
lying distribution from which the states were taken. That 
is, they map the microstates in our sample to the pure 
states from which they were taken. 

At the highest level, the dendrogram splits into two 
identical trees, which are the two spin-flip related pure 
state trees. We consider the states that belong to one 
(the left). For all {J} we call the two top level state 
clusters by Ci and C2 with the convention \Ci\ > IC2I. 
The two subclusters of Ci are denoted by Cia and Cib- 
The triplets of microstates for which we test UM are se- 
lected as follows: fi G Cia, v S Cu and p G €2- If state 
space is ultrametric and these clusters correspond to the 
underlying pure states, we expect d^p — d^p > d^u ■ 

Direct Measurement of Ultrametricity: For each triplet 
of states /i, V and p selected as described above, we define 
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TABLE I: The values of if as a function of A^, for both the SK and 3dISG. See text for definitions. 



an index 

K^,^p = . (2) 

Note that < K^^p < 1 due to the triangle inequahty. 

For a given reahzation {J} we identify Cia, Cif,, and 
C2, and measure if^^p over all the corresponding state 
triplets. We discard triplets with K = 1 since these 
correspond to co-linear "triangles" - they are the re- 
sult of a finite size effect, and their weight P{K — 1) 
decreases rapidly with increasing system size, as seen 
in Table ^ We calculate the distribution Pj{K) = 
PjiKppv = K\Kpp^ < 1), and its mean Kj. We then 
average over the realizations {J} to get K = [ifjjav and 
P{K) = [Pj(ivr)]av. If state space is UM in the thermo- 
dynamic limit, we expect if — » and P{K) <5(if ) as 
N 00. 
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FIG. 2: The distributions P{K) (see text), calculated for 
3dISG and SK systems for various sizes N. 



We present in Fig. [21 the distributions P(K) obtained 
for a sequence of sizes N for the SK and 3dISG models. 
For the SK model the peak of P{K) is at if = and it's 
width decreases as N increases, as expected if P{K) is to 
approach S{K). The behavior is markedly different for 
the 3dISG: the width of the distribution remains constant 
and its peak is at if ~ 0.8. For the SK model the values 
of if, presented in Table U are smaller, decrease faster 
and approach zero as N increases, whereas for the 3dISG 
if seems to go to a non- vanishing limiting value. For both 
systems the lowest size is useless for estimating the trend 
with increasing N. 

We present also results obtained for the SK model by 
a "naive" calculation, that neglects to ensure that all 
members of a triplet of states are drawn from the same 
side of the dendrogram; such oversight indeed renders 
UM unobservable, as also noted by [liJ, [iJl . 

Another test of UM is the following: if the state space 
is ultrametric, then the distance between states /i € Ci 
and e C2 depends only on the identity of their closest 
common ancestor on the tree of pure states, which is 
Ci UC2. Thus, for each realization, the sub-matrix qciC2 
should be uniform (e.g. the rectangle in the distance 
matrix of Fig. ^ that connects states from Ci and C2, 
should be uniformly shaded). 

We have calculated the standard deviation SC1C2 and 
the average mc^CjOf the elements of (7C1C2 foi' each realiza- 
tion {J}. For a given average m the standard deviation 
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TABLE II: The standard deviation SC1C2 and the normalized 
standard deviation SciC2 of the elements of qciC2 (see text), 
averaged over realizations of the disorder {J}, for 3dISG and 
SK systems of difi'erent sizes. 
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is bounded by \/ to(1 — m) - the standard deviation of a 
Bernoulli distribution. We define a normalized standard 
deviation Sc^c^ = sciCs/ V"^CiC2 (1 - "^CiCs)- We aver- 
age over the realizations to get [sciC2]av and [>S'ciC2]av 
The results are given in Table For the SK model 
both [sciC2]av and \Sc^C'Aw decrease rapidly as N in- 
creases, indicating again that UM is approached, while 
for the 3dISG the values of [sciC2]av and [S'ciC2]av seem 
to asymptote to 0.04 and 0.13 respectively. 

To test the validity of the mean field solution without 
using clustering methods, we focused on one of several 
results for multi overlap distributions. Mezard et al. gj 
showed that the distributions P.j{q) of ISG satisfy the 
relation 



[Pj{qi)Pj{q2) 



- 3^(91)^(92) 



-P{qi)S{qi ~ q2) 



(3) 

which, just like UM, is a consequence of Parisi's mean 
field solution. Eq. Q has been derived for the SK model 
without replicas by Guerra jl^ and, mo re g enerally, is a 
consequence of "stochastic stability" 0, 0| . In order to 
test the validity of Eq. Q we define 

3[Pj(gi)Pj(g2)]av-2P(gi)P(g2) 



piqi,q2) = 



(4) 



^'('Zi) 

We study p{Aq) - the average of p over overlap pairs 
{91,(72} with \qi — (72I = ^q- As ^ 00 we expect p 
to have a (5-peak at Aq = In general, this peak 

can have a small weight and p may have a continuous 
part, while in the mean field solution p{Aq) converges to 
SiAq). 

Fig. [^presents p{Aq). For the SK model p approaches 
5{Aq) with increasing N , while for the 3dISG the height 



of the peak at decreases and seems to converge to a 
finite value, and the width remains constant. For this 
case we conclude that p is the sum of a d{Aq)-peak, and 
a continuous term; the rise of the first with N is masked 
by the decrease of the second. 

We also examined the equality of the second moment 

of Eq. ®: [{q^fU = |[(9')]av' + l[{q^)U, wHch has 
been investigated numerically in other work [20j. We 
find that the ratio of the two sides is one for both SK 
and 3dISG of all sizes within an error smaller than 0.03, 
in agreement with Ref. However, moments may be 
insensitive to deviations from Eq. (jS} because p « when 
\qi-q2\ > 0.2. 

Top conclude, we have presented strong evidence for 
the lack of UM in the low T phase of the 3-dimensional 
short range Ising spin glass. We conclude that our meth- 
ods are able to detect UM, where it exists, at the sys- 
tem sizes studied. Our findings indicate that the struc- 
ture of the low-temperature phase of spin glasses that 
emerges from the mean-field solution is not valid for the 
3-dimensional short range Ising spin glass. 
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FIG. 3: The function p{Aq) for SK and 3dISG systems. The 
error bars are smaller than the symbols. 
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